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© Signal encoding and decoding system allowing adding of signals in a form of frequency sample 
sequence upon decoding. 
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© In a signal compressing and encoding apparatus, a plurality of A/D converters sample input audio signals 
synchronously to produce time sample strings. An audio encoding circuit transforms time sample sequences in 
time/frequency by a frame interval to produce frequency sample sequences. The frequency sample sequences 
are compressed, encoded and formatted into a frame structure to generate audio bit streams. The audio bit 
streams are multiplexed by a formatter into a multiplexed bit stream. On the other hand, in a compressed signal 
decoding circuit, a quantization decoder decodes the frequency sample sequences for each bit stream 
separated and extracted selectively out of the multiplexed bit stream. A adding result the decoded frequency 
sample sequences to produce a summing result. The summing result is then transformed in frequency/time by a 
frequency/time mapping to produce the time sample sequences. 

FIG. 1 
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The present invention relates to a signal compression and encoding apparatus for compressing and 
multiplexing, for example, audio or video signals and a compressed signal decoding apparatus for decoding 
the compressed and multiplexed audio or video signals. The present invention also relates to a combined 
system of these apparatuses. 

5 To transmit/record digitized audio, acoustic signals requires a large volume of data, so that a huge 

transmission or storage capacity is required. With this respect, there has been a strong demand on a 
technique for compressing data. 

Typically the human perceptual system is known not to receive all stimulation equally, and a part of the 
stimulation at that time is received while the remaining parts are not received. Discrimination of the 

10 perceived component and non-perceived component is known to be made effectively in frequency areas. 
With this respect, a compression algorithm of high efficiency using this principle has been developed. More 
specifically, time sample sequence is converted into a frequency sample sequence by using an orthogonal 
transform technique. The currently major method is the one to compress data on this frequency sample 
sequence. Examples of the transform in time/frequency include Discrete Cosine Transform (DCT) and 

75 Modified Discrete Cosine Transform (MDCT). The DCT algorithm is similar to Fast Fourier Transform (FFT), 
that converts data into sets of frequencies. In addition, subband filters where a large number of bandpass 
filters are aligned are also known: 

One technique for compressing and encoding audio data is developed by the Moving Pictures Experts 
Group (MPEG), International Standards Organization (ISO) standard for compressing video (ISO/IEC-1 1 1 72- 

20 3). Fig. 11 is a simple block diagram associated with this MPEG encoding. Input signals are audio digital 
signals sampled typically at sampling frequencies of 48 kHz, 44.1 kHz, or 32 kHz. Output can be selected 
for bit-streams of from 32 kbps to 448 kbps. Three layers, Layers I, II, and III; are defined according to 
compression efficiencies. Layers I and II based on the same fundamental algorithm are now described. 

Input is supplied to a block 1 called mapping and then supplied to a subband filter group which 

25 segments a frequency region into thirty-two. The subband filter output is subjected to stripping to strip one 
sample by thirty-two samples. The subband filter is the one where it is ensured that the number of samples 
before passing through the subband filter is the same as that after passing therethrough without any change 
of the number of samples (i.e.. the samples are critically sampled) and that the original time sample 
sequence can be de-formatted completely by this inverse transform. Accordingly, it can be understood that 

30 the input signal is transformed into a frequency sample sequence by the certain number of time samples in 
the approach using the subband filters, as in the one using the orthogonal transform technique. 

As the mapping block 1, the input signal is supplied to a psychoacoustical model block 2. In this block 
2, a frequency spectrum is obtained out of the input sample sequence by means of transformation in 
time/frequency (e.g., FFT) based on a certain frame independently of the mapping block 1. A length of this 

35 frame corresponds to 12 blocks (Layer I) or 36 blocks (Layer II) of the transform block of the above 
mentioned subband filter. In various schemes without using the subband filter, an orthogonal transform 
results in a large output. Accordingly, a frequency spectrum of this output may be used for calculation of 
the psychoacoustical model. 

A signal to mask ratio (SMR) is then obtained between a signal level (S) of each subband, calculated 

40 out of the frequency spectrum by using the psychoacoustical model, and a mask level (M) which is not 
recognized acoustically due to masking effects. A quantization and coding block 3 resolves the output 
sample of the mapping into a product of the signal level (S) and a sample value (D(i)), namely, 

OUTPUT SAMPLE = S D(i). 

45 

The signal level (S) is referred to as a scale factor indicative of the level into which a sample of the 
maximum value is classified, within the subband of the frame. The frequency samples are quantized with a 
bit number obtained according to SMR into D'(i). The bit number is allocated to.the frequency sample, and 
this process is referred to as a bit allocation. A quantization noise (N) or an artifact generated as a result of 

so quantization will not be recognized even with the smaller bit number if this noise is lower than the masking 
level. The data is thus compressed. 

The bit allocation, the scale factor, and the sample data are formatted into a bit stream sequence having 
a frame structure by a frame packing block 4. At the decoding side, this bit stream is received and frame 
synchronization is achieved by a frame unpack block 5. The bit allocation scale factor, and sample data are 

55 separated from each other for extraction. The frequency sample sequence is then reproduced by a 
quantization decoding block 6 and the time sample sequence is reconstituted by an inverse mapping block 
7. As a result, a reproduced acoustic signal is obtained. 
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Fig. 12 shows an exemplified structure of a bit stream. A head of one frame is a header 21 having 
information about frame synchronization codes and other information regarding to. for example mode This 
is followed by the bit allocation 22, the scale factor 23. and the sample data 24. A supplementary data may 
follow it. One frame comprises one or more blocks for a time-to-frequency transform, 
s With a system for transmitting and storing audio signals associated with video images, the acoustic and 

audio signals should be in the form of two or more channels when two or more different languages are 
used. More specifically, the acoustic signal common for all languages and channels for respective 
languages are transmitted or stored. At the receiving or reproducing side, the common channel and one 
language are selected, which are summed and produced. Such "multi-channeled" acoustic signal may be 
jo compressed into bit streams by using one of following two techniques. 1 

The first method is the one to compress all channels into a single bit stream. For MPEG, this approach 
has been realized in a new process of standardization as MPEG 2. 

This method is. however, disadvantageous when the number of languages is increased. A bit rate of the 
bit stream (bit per second; bps) is increased to ensure sound of a significant quality. The bit rate (bps) of 
rs the compressed bit stream has certain limitations in a case where compression of two channels is 
fundamental as in MPEG. Such limitations are required to avoid elongated time for frame synchronization 
even with one audio frame has the increased number of bits in a two-channel mode. The limitation also 
ensures that the number of input buffer registers is not changed with the increased bit rate of the 
compressed bit stream during decoding operation. As apparent from the above, the standardized bit stream 
20 limits the number of channels available. 

The second method is the one to construct a plurality of bit stream systems with signals on two or 
more channels being separate bit streams. This allows a system for many languages (channels) with the 
standard bit stream. In this event, only the bit stream on the desired channel is decoded at the decoding 
side. It is. however, necessary to decode separately the bit streams on the common acoustic channel and 
the channel for the selected language, increasing the amount of processing by two. 

Fig. 13 shows an example of such multi-channel system. In this event, each audio input may be 
monaural or be on multiple channels as in stereo. In this system, a number of audio input signals are first 
subjected to audio compression/encoding by a number of audio encoders 31, 32. 33, 34. Bit streams are 
each multiplexed by a bit stream multiplexer/formatter 41 into a system bit stream. A video signal may be 
multiplexed, if the system include video signals. In addition, system information may also be multiplexed 
that is required for synchronization between the video and audio signals. 

At the reproduction side, the video and audio bit streams and the system information are separated 
from each other by a demultiplexer 42. Processing of audio is made by means of selecting a desired bit 
stream from the reproduced audio bit streams and decoding it by using audio decoders 43 and 44 If a 
plurality of audio bit streams are selected, the audio decoders 43 and 44 decode compressed audio bit 
streams separately and independently. The decoded audio signals are mixed by a mixer/summer 45 and 
then produced. 

As described above, conventionally, when a plurality of bit streams are formed for input signals of plural 
systems such as audio and acoustic signals to multiplex them, the multiplexed bit streams should each be 
decoded by using separate systems upon reproduction thereof. It is thus necessary to provide a plurality of 
decoding circuits having the same structure and function, disadvantageous^ increasing the scale and the 
dimension of the resultant circuit. 

The present invention is to solve such problems and is directed to provide a signal compression and 
encoding apparatus, a compressed signal decoding apparatus, and a combined system of these apparatus 
that allow gathering frequency-to-time transform units together as one unit in a circuit structure of decoding 
system, thereby reducing a scale of the circuit when signals on plural input lines are each subjected to 
time-to-frequency transform, compressed, and multiplexed. 

In the present invention, input signals on a plurality of input lines are each synchronized and sampled in 
sampling means to. produce a time sample sequence. Next, each time sample sequence obtained by the 
sampling means is received in encoding means. The received time sample sequence is transformed in 
time/frequency while being synchronized by a predetermined time interval to produce frequency sample 
sequences. The frequency sample sequences are compressed and bit streams are produced that are 
formed of a predetermined format including the compressed frequency sample sequence. The above 
mentioned plurality of bit streams are multiplexed by multiplexing means. — 

A plurality of bit streams are selectively separated and extracted from the multiplexed bit stream by 
separating means. The frequency sample sequence is de-formatted by de-formatting means for each of 
these mdividual bit streams. The de-formatted frequency samples are summed to each other, the summing 
result of which is transformed in frequency/time to produce the time sample sequence 
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More specifically, in the present invention, audio signals on plural input lines are sampled while being 
synchronized with each other to form a multiplexed bit stream that is frame-synchronized between audio on 
the individual input lines, which permits, upon decoding, summing in the frequency sample sequences as 
compared to summing of the time sample sequences conventionally. As a result, the frequency-to-time 
5 transform requires only one input line, allowing a simplified circuit structure. 

These and other objects, features and advantages of the present invention will become more, apparent 
in light of the following detailed description of the preferred embodiments as illustrated in the accompanying 
drawings in which: , 

Fig. 1 is a block diagram illustrating a structure of a signal compressing and encoding apparatus 
to according to one embodiment of the present invention; 

Fig. 2 is a block diagram illustrating a structure of a compressed signal decoding apparatus according to 
one embodiment of the present invention; , 

Fig. 3A is a view illustrating a relationship between a frequency spectrum and a time sample sequence in 
a frequency sample sequence of one bit stream; 
75 Fig. 3B is a view illustrating a relationship between a frequency spectrum and a time sample sequence 
in a frequency sample sequence of one bit stream; 

Fig. 3C is a view illustrating a relationship between a frequency spectrum and a time sample sequence 
in a frequency sample sequence of a added bit stream; 

Fig. 4 shows an example where the transform block is overlapped withan adjacent block by 50%; 
20 Fig. 5 is a circuit block diagram of a reproduction system for use in describing another embodiment of 
the present invention; 

Fig. 6 is a view for use in describing and illustrating an asynchronous relation between a video frame and 
an audio frame; 

Fig. 7 is a block diagram illustrating a structure of a signal compression and encoding apparatus 
25 according to another embodiment of the present invention; 

Fig. 8 is a block diagram illustrating a structure of a compressed signal decoding apparatus according to 
another embodiment of the present invention; 

Fig. 9 is a block diagram illustrating another embodiment in which a buffer is displaced in the 
compressed signal decoding apparatus illustrated in Fig. 8; 
30 Fig. 10 is a block diagram illustrating a structure of yet another embodiment of the compressed signal 
decoding apparatus according to the present; invention; 

Fig. 11 is a block diagram for use in describing anvaudio signal compressing and encoding system; 
Fig. 12 is a view showing a bit stream; and 

Fig. 13 is a block diagram illustrating a structure of a conventional multi-channel compression system. 
35 . Embodiments of the present invention are described now^with reference to the drawing. 

Fig. 1 is a block diagram illustrating a structure of a signal compressing and encoding apparatus in a 
multiplexed bit stream transmission/reproduction system according to one embodiment of the present 
invention. ^ ; 

In this figure, 51. 52, 53, and 54 are A/D converters that receive audio input signals #1, #2, #3. and #4; 
40 respectively, on plural input lines to convert them into digital data. The audio input signals #1. #2, #3, and 
#4 may be music, effects sound, multilingual voice sounds, stereo sound, or monaural sound in media such 
as movies. 55, 56, 57, and 58 are audio encoders that are connected with outputs of the A/D converters 51, 
52, 53, and 54, respectively. 

The A/D converters 51-54 and the audio encoders 55-58 are supplied with a common sampling clock 
45 from a control unit 50. In addition, the audio encoders 55-58 are supplied with a frame clock from the 
control unit 50. The A/D converters 51-54 and the audio encoders 55-58 each produces an audio bit stream 
including frequency sample sequences for the audio input signals #1-#4 and sends them to a bit stream 
multiplexer/formatter 59. 

More specifically, each of the A/D converters 51-54 samples the input audio signal at a timing of the 
so above mentioned common sampling clock, and supplies the corresponding audio encoding unit 55-58 as 
the time sample sequence. Each of the audio encoding units 55-58 transforms in time/frequency the time 
sample sequences supplied from the corresponding A/D converters 51-54 by the: frame intervals according 
to the above mentioned common frame clock to obtain the frequency sample sequences. They are 
compressed and encoded, and are then formatted into frame structures, thereby the audio bit streams are 

55 produced. ._ 

The bit stream multiplexer/formatter 59 multiplexes the audio r bit streams produced by the audio 
encoders 55-58 and video bit streams taken from a video encoder 60 to produce a multiplexed bit stream. 
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Next, described is a compressed signal decoding apparatus in the multiplexed bit stream transmis- 
sion/reproduction system according to this embodiment of the present invention. 

Fig. 2 is a block diagram showing a structure of this compressed signal decoding apparatus. In this 
figure, 61 is a bit stream demultiplexing circuit 61 that receives the multiplexed bit streams to demultiplex 
s the same into bit streams for individual input lines. This bit stream demultiplexing circuit 61 separates and 
extracts two or more desired audio bit streams out of the multiplexed each audio bit stream. 62 and 63 are 
frame synchronization circuits where each audio bit stream separated and extracted by the bit stream 
demultiplexing circuit 61 is subjected to frame synchronization and is then supplied to processing sections 
in a subsequent stage. 64 and 65 are de-formatting circuits where each frame-synchronized audio bit 
10 stream is subjected to analysis on each bit and is separated into the bit allocation, the scale factor, and the 
frequency sample sequences. 66 and 67 are quantization decoding units 66 that decode the frequency 
sample sequences of the individual audio bit streams. 68 is a common mixing/adding circuit 68. Each 
decoded frequency sample sequence is added for frequency samples at corresponding locations by this 
mixing/adding circuit 68 on one input line. The frequency sample sequence added on one input line is then 
rs supplied to a frequency/time mapping unit 69 and is converted into a time sample sequence for output. 
Thereafter, the time sample sequence is converted into an analog signal through a D/A converter 70 as an 
audio output signal. 

Figs. 3 A-C illustrate a relationship of a frequency spectrum and a time sample sequence. In this event, 
Figs. 3A and 3B illustrate process of transforming frequency sample sequences consisting of different bit 
20 streams into time sample sequences by a certain transformation block. On the other hand, Fig. 3C 
illustrates process of transforming a summing result of the frequency sample sequences in Figs: 3A and 3B 
into a time sample sequence by a certain transformation block. 

As mentioned above; the sum of the two or more frequency sample sequences can be transformed in 
frequency/time to obtain the original time sample sequence. This means that the sum of the frequency 
25 sample sequences is equivalent to the time sample sequence. The reason of this is described now. 
The orthogonal transform and the inverse transform are generally expressed as follows: 



30 
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X(m) = jj^k. x (n) C n n (1) 



x(n) = jc*k. X (m) c n B . (2), 



where 

x(n) represents an n-th time sample, 
X(m) represents an m-th frequency sample. 
40 C m n represents a core of the orthogonal transform, or an orthogonal transform coefficient, 

m = 0, .... N-1 
k m = 1/2 1/2 m = 0, 
= 1 m*0. 



The equation (2) indicates the frequency-to-time transform. Let the frequency sample sequences of the 
bit stream be X(m) and Y(m), an output sample z(n) can be given by: 

N-1 

z(n) = E o k m {<aX(m) ■+ bY(m)> C ro n 

9 



= ax(n) + by(n) 
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where a and b are summing coefficients. 

Accordingly, the sum of the frequency sample sequences is equivalent to the time sample sequence. 

For DCT, these equations are described in, for example, K. R. Rao and P. Yip, "Image Encoding 
Technique - DCT and International Standardization of It", Ohm Corporation. 

5 According to this embodiment, the audio signals on plural input lines are sampled in a synchronous 

manner and a multiplexed bit stream is constructed with the audio signals for individual input lines in frame 
synchronization relation. As a result, the audio signals can be added upon decoding and reproduction in the 
form of the frequency sample sequences, which otherwise was made in the form of the time sample 
sequence in conventional arts. This requires only one input line for the frequency-to-time transform, 

70 resulting in a simplified circuit structure. In addition, the number of processing steps can be reduced when 
the above mentioned processing is achieved by software using a digital signal processor or the like. 

In Fig. 3, a transform block may be overlapped with an adjacent block along the time axis for a case, for 
example, of the MDCT and the subband filters. Fig. 4 shows an example where the transform block is 
overlapped with an adjacent block by 50%. In this event, a window coefficient is multiplied with each 

75 frequency sample sequence. These frequency sample sequences are added together for an overlapping 
time. This frequency-to-time transform provides the time samples as twice the number as the frequency 
samples. However, the number of the samples becomes one-half as a result of the overlap adding 
processing. Accordingly, the number of the output samples become equal to that of the frequency samples. 
The present invention can thus be applied equally to this case. 

20 A principle of the MDCT is described in, for example, "Analysis/Synthesis Filter Bank Design Based on 

Time Domain Aliasing Cancellation" (IEEE Transaction on Acoustics, Speech, and Signal Processing: Vol. 
ASSP-34, No. 5, October 1986, pages 1153 to 1161). : 

While this embodiment has thus been described in conjunction with the case where the- frame 
synchronization is achieved for each audio bit stream, the frame synchronization may be achieved for at 

25 least one audio bit stream as shown in Fig. 5. 

Next, a yet another embodiment of the present invention is described. The video frames and the audio 
frames are naturally asynchronous with each other as shown in Fig. 6. With this respect, this embodiment 
constructs such that the audio frames on a plurality of input lines are each in a synchronous relation and 
that the audio and video frames are also in a synchronous relation. 

30 Fig. 7 is a block diagram illustrating a structure of a signal compression and encoding apparatus of this 

embodiment. In this figure, like reference numerals indicate like components and parts as in Fig. 1 and a 
detailed description thereof will be omitted. The signal compression and encoding apparatus in this 
embodiment is similar to the one described in Fig. 1 except that a video/audio synchronization information 
generating unit 71 is added. The video/audio synchronization information generating unit 71 is generates 

35 synchronization information for use in synchronizing the audio and video bit streams upon reproduction at a 
timing of the audio frames supplied from a predetermined audio coding unit (such as 55) as well as a timing 
of the video frames supplied from the video encoding unit 72. The video/audio synchronization information 
generating unit 71 supplies the synchronization information to the bit stream multiplexer/formatter 59: The 
synchronization information is further multiplexed into the multiplexed bit stream; This video/audio synchro- 

40 nization information is associated with a frame number of the audio signal to be reproduced ; at a given 
frame number of the video signal and with a sample number indicative of a position in the audio frame in 
question corresponding to an edge of the video frame. 

Conventionally, it is necessary for producing video/audio synchronization information for each of the 
audio bit streams to achieve synchronization of the audio signals with the video signal by using the 

45 video/audio synchronization information because the audio bit streams in one input line are not in a 
synchronous relation with those in other input line. On the other hand, in the present embodiment, the audio 
bit streams in the individual input lines are. in the synchronous relation with each other. The video/audio 
synchronization information is required to be generated only for one audio signal out of plural ones. 
Accordingly, the circuit required for this can be simplified. 

so Next, a compressed signal decoding apparatus thereof is described. Fig. 8 is a block diagram 
illustrating a structure of the compressed signal decoding apparatus. Like reference numerals indicate 
similar components and parts as in Fig. 2, and a detailed description thereof will be omitted. The bit stream 
demultiplexing circuit 61 demultiplexes the. received multiplexed bit stream to extract the video bit stream, 
the selected audio bit stream, and the video/audio synchronization information. The video bit stream is 
... 55 . supplied to a video decoding unit 91 and is decoded into a video output. The audio bit streams in the. _ 
individual input lines are supplied to buffers 82 and 83. The audio bit streams in the individual systems are 
delayed by the buffers 82 and 83 and are supplied to a processing circuit in the subsequent stage (the 
frame synchronization circuit 62, the de-formatting circuits 64 and 65). 
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On the other hand, the video/audio synchronization information is supplied to a video/audio synchroniza- 
tion control circuit 84. The video/audio synchronization control circuit 84 calculates a delay amount for each 
of the buffers 82 and 83 according to the video/audio synchronization information, the video frame timing 
signal supplied from the video decoding unit 81, and the audio frame timing signal supplied from the frame 

5 synchronization circuit 62. More specifically, the video/audio synchronization control circuit 84 controls the 
delay amounts for the buffers 82 and 83 such that the audio frames of the individual systems are 
synchronized with the video frames. In this event, the audio bit streams in each system are synchronized 
with each other, so that one delay amount can be used commonly for the buffers 82 and 83. Accordingly, 
only one video/audio synchronization control circuit 84 is required for a simple structure. 

io While the buffers 82 and 83 are provided at the input for the audio bit stream in this embodiment, only 
one buffer 91 may be provided at the output for the audio bit stream as shown in Fig. 9 for synchronizing 
video and audio frames. 

Yet another embodiment of the present invention is described. Fig. 10 is a block diagram illustrating a 
structure of a compressed signal decoding apparatus according to this embodiment. Like reference 

75 numerals indicate similar components and parts as in Fig. 2. and a detailed description thereof will be 
omitted. As shown in the figure, the compressed signal decoding apparatus comprises a synchronization 
determination unit 101. The synchronization determination unit 101 compares the frame timings detected 
from the individual audio bit streams to verify that the synchronization is achieved between the audio 
frames. If the synchronization is not achieved, the synchronization determination unit 101 carries out control 

20 to correct this synchronization error. For example, the synchronization determination unit 101 determines a 
correct synchronization timing by majority operation when the odd number of bit streams are selected. In 
addition, the synchronization determination unit 101 adjust the synchronization timing of minorities to the 
timing of the majorities. As a result, the synchronization of the audio bit streams are achieved with a higher 
accuracy. 

25 The present invention can be applied to a case where the sampling frequencies are not equal in 
production of the bit streams of the audio signals in a plural systems. For example, the one sampling 
frequency may be one-half of the other as long as the two are in synchronism with each other. In this event, 
it is necessary to determine or select adequately a length of a time-to-frequency transform relative to the 
individual audio signals, and to make the position on the frequency axis of the frequency sample sequences 

30 of them be associated with each other in an adequate manner. In addition, the sampling frequencies may 
be in a ratio of, for example, 48 (kHz) to 32 (kHz) as long as they both are in synchronism with each other. 
In this event, the corresponding frequency samples can be obtained on the frequency axis as shown in Fig. 
3 by means of calculating interpolating samples using a known frequency transform technique. The 
resultant frequency samples can be added on the frequency axis. 

35 In the present invention, the number of the audio bit streams selected in the decoding apparatus not 
limited to two, and any positive integer can be applied. The number of the audio systems in each bit stream 
can also be selected arbitrary. The present invention is applicable as long as the mixing down can be 
achieved between the bit streams upon decoding. 

As mentioned above, according to the present invention, the audio signals can be added upon decoding 

40 and reproduction in the form of the frequency sample sequences, which otherwise was made in the form of 
the time sample sequence in conventional arts. This requires only one system for the frequency-to-time 
transform, resulting in a simplified circuit structure: 

In addition, when video and audio are multiplexed, the audio bit streams in the individual input lines are 
synchronized, so that the only thing required is to produce video/audio synchronization information for a 

45 single audio signal of a plurality of input lines. It is thus possible to simplify the circuit structure associated 
therewith. 

Claims 

1. A system for encoding and decoding signals, the system transmitting or storing a multiplexed bit 
stream and decoding the transmitted or stored multiplexed bit stream, the multiplexed bit stream 
produced by compressing, encoding and multiplexing input signals of a plurality of input lines, and the 
system comprising: 

(a) a signal compressing and encoding apparatus comprising: 

sampling means (51-54) for sampling said input signals of .said input lines while synchronizing 
between said input signals of said input lines, and outputting time sampled sequences composed of 
said sampled signals; 

encoding means (55-58) for transforming the time sampled sequences into frequency sampled 
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sequences while synchronizing between said time sampled sequences, compressing and encoding 
the transformed frequency sampled sequences, and producing a first bit stream having a predeter- 
mined format including the compressed and encoded frequency sampled sequences; and 

multiplexing means (59) for multiplexing the first bit streams generated by the encoding means 
5 to output the multiplexed bit stream, and 

(b) a compressed signal decoding apparatus comprising: 

separating means (61) for separating selected first bit streams from the multiplexed bit streams, 
said first bit streams selected out of the multiplexed bit streams; . 

decoding means (66, 67) for decoding each of the first bit streams separated by the Separating 
70 means into the frequency sampled sequences; 

adding means (68) for addition of the frequency sampled sequences decoded by the decoding 
means to produce a sum; and 

transforming means (69) for transforming the sum into time sampled sequences, and outputting 
the transformed time sampled sequences. 

15 

2. A signal compressing and encoding apparatus for producing? a multiplexed bit stream by compressing 
and encoding input signals of a plurality of input lines, comprising: 

sampling means (51-54) for sampling said input signals of said input lines while synchronizing 
between said input signals of said input lines, and outputting time sampled sequences composed of 
20 said sampled signals; 

encoding means (55-58) for transforming the time sampled sequences into frequency sampled 
sequences while synchronizing between said time sampled sequences, compressing and encoding the 
transformed frequency sampled sequences, and producing a first bit stream having a predetermined 
format including the compressed and encoded frequency sampled sequences; and 
25 multiplexing means (59) for multiplexing the first bit streams generated by the encoding means to 

output the multiplexed bit stream. 

3. A signal compressing and encoding apparatus, wherein sampling of said input signals of said input 
lines while synchronizing between said input signals of said input lines, and the time sampled 

30 Sequences are transformed into frequency sampled sequences while synchronizing between said time 

sampled sequences, and the transformed frequency sampled sequences are compressed and en- 
coded, and a first bit stream having a predetermined format including the compressed and encoded 
. frequency sampled sequences, and the produced bit stream is multiplexed, and the multiplexed bit 
stream is decoded, 
as further comprising: 

separating means (61) for separating selected first bit streams from the multiplexed bit streams, 
said first bit streams selected out of me multiplexed bit streams; 

decoding means (66, 67) for decoding each of the bit streams separated by the separating means 
into the frequency sampled sequences, 
40 adding means (68) for addition of the frequency sampled sequences decoded by the decoding 

means to produce a sum, and 

transforming means (69) for transforming the sum into the time sampled sequences, and outputting 
the transformed time sampled sequences. 

45 4. A system as claimed in Claim 1 or an apparatus as claimed in Claim 3, wherein the decoding means 
(66, 67) decode the first bit streams selected by the separating means (61) into frequency sampled 
sequences while synchronizing with only one first bit stream of the separated first bit streams. 

5. A System for encoding and decoding signals as claimed in Claim 1, wherein the signal compressing 
so and encoding apparatus further comprises synchronization information generating means (71) for 

generating synchronization information for use in achieving synchronization with the first bit stream 
generated by the encoding means (55-58) with a second bit stream which is different from the first bit 
stream; the multiplexing means (59) for multiplexing the first bit stream, the second bit stream, and the 
synchronization information to output a multiplexed bit stream; and the Separating means (61) for 
55 separating selected first bit streams, second, bit streams and synchronization information selected from 

the multiplexed bit streams, 

and the compressed signal decoding apparatus further comprises synchronization controlling 
means (84) for ensuring synchronization between the first and the second bit streams in accordance 
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with the separated synchronization information. 

A signal compressing and encoding apparatus as claimed in Claim 2, further comprising: 

synchronization information generating means (71) for generating synchronization information for 
use in achieving synchronization between the first bit stream generated by the encoding means (55-58) 
and a second bit stream which is different from the first bit stream, wherein multiplexing means (59) 
multiplexes the first bit stream, the second bit stream and the synchronization information to output 
multiplexed streams. 

A signal compressing and decoding apparatus as claimed in Claim 3, wherein the Separating means 
(61) separates selected first bit streams, second bit streams which are different from the first bit 
streams, and the synchronization information, and further comprising synchronization controlling means 
(84) for ensuring synchronization between the first and the second bit streams in accordance with the 
separated synchronization information. 

A system as claimed in Claim .5 or an apparatus as claimed in Claim 7, wherein the synchronization 
controlling means (84) ensures synchronization between the first and the second bit streams at a 
position between the separating means (61) and the decoding means (66, 67). 

A system as claimed in Claim 1 or an apparatus as claimed in Claim 3, wherein the synchronization 
controlling means (84) ensures synchronization between the first and the second bit streams after 
transformation carried out by the transforming means (69). 

10. A system as claimed in Claim 1 or an apparatus as claimediin Claim 3, further comprising: 

synchronization detecting means (62, 63) for detecting a frame synchronization timing for the first 
bit stream separated by the separating means (61); and 

controlling means (101) for comparing the detected frame synchronization timings with each other 
to determine a synchronization error between the first bit streams, the controlling means carrying out 
control such that the synchronization error is eliminated when the synchronization error is caused. 

11. A System or an apparatus as claimed in Claims 5 - 9, wherein the first bit stream is a bit stream 
relating to audio and the second bit stream is a bit stream relating to video. 

12. A method for transmitting and storing a multiplexed bit stream and decoding the transmitted or stored 
multiplexed bit stream, the multiplexed bit stream produced by comprising, encoding and multiplexing 
input signals of a plurality of input lines, and the method comprising the steps of: 

sampling said input signals of said input lines while synchronizing between said input signals of 
said input lines, and outputting time sampled sequences composed of said sampled signals; 

.transforming the time sampled sequences into frequency sampled sequences while synchronizing 
between said time sampled sequences, compressing and encoding the transformed frequency sampled 
sequences, and producing a first bit stream having a predetermined format including the compressed 
* and encoded frequency sampled sequences; 

- multiplexing the first bit streams generated by the encoding means to output the multiplexed bit 
stream; 

separating selected first bit streams from the multiplexed bit streams, said first bit streams selected 
out of the multiplexed bit streams; 

decoding each of the first bit streams separated by the separating means into the frequency 
sampled sequences; - 

adding means for addition of the frequency sampled sequences decoded by the decoding means 
to produce a sum; . 

transforming the sum into the time sampled sequence, and outputting the transformed time 
sampled sequence. 
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FIG. 3A 
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(54) Signal encoding and decoding system allowing adding of signals in a form of frequency 
sample sequence upon decoding 



(57) In a signal compressing and encoding appara- 
tus, a plurality of A/D converters sample input audio sig- 
nals synchronously to produce time sample strings. An 
audio encoding circuit transforms time sample 
sequences in time/frequency by a frame interval to pro- 
duce frequency sample sequences. The frequency 
sample sequences are compressed, encoded and for- 
matted into a frame structure to generate audio bit 
streams. The audio bit streams are multiplexed by a for- 



matter into a multiplexed bit stream. On the other hand, 
in a compressed signal decoding circuit, a quantization 
decoder decodes the frequency sample sequences for 
each bit stream separated and extracted selectively out 
of the multiplexed bit stream A adding result the 
decoded frequency sample sequences to produce a 
summing result. The summing result is then trans- 
formed in f requency/time by a frequency/time mapping 
to produce the time sample sequences. 
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